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ABSTRACT 

A 6 2- item form of the sentence- completion technique 
requiring one-word responses was administered to 1718 undergraduates 
in teacher education. The data were punched on cards and lists of 
(jj^fferent responses were compiled. Responses indicating evasion, 
hostility, anxiety andi depression were identified for each st^ to 
form a scoring "dictionary." A computer program scored all protocols 
for these four variables, as well as populars, average response 
length and repetitions. Descriptive statistics, internal consistency 
reliabilities, and intercorrelations of the variables are reported, 
as well as concurrent validities against a self-report questionnaire 
and comparisons of sex and teaching-level subsamples. (Author) 



CM 

T^ 

vD 

vD 

O 

Q 

UJ 



CO 



CN! 

O 

O 



U.S. DEPARTMENT OF HEALTH. 
EDUCATION ft WELFARE 
OFFICE OF EDUCATION 
THIS DOCUMENT HAS SEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT. POINTS OF VIEW OR OPIN- 
IONS STATED DO NOT NECESSARILY 

represent official office of edu- 
cation POSITION OR POLICY 



Aulomdioil riOnlonco Comp I o Mon Scoririfi 



UoMijItJ J. Vuldmnn 
Iho UnivoP-iiiy o( luxiv; Auiilin 



A form of tin; isonioMce-comp lei Ion lochn Iquo roqul rl mj 

oMO“Word roisponiioo wug cjdininiii I’orod 1o I7I0 underqroduatos In toocher 
educi.vtlon» Ihe dc)lo were piiriL'IuMl on cards i.nd Ijsls of dlffo^on^ re- 
sponses wuro compiled. Uusponsos hullcoHm) evasion, hosi i 1 1 !y , anxiety 
and d(jp roiis i < *M wi*ro idtsnlifled for each slem to form o ocorlnq dictionary* 
A computer |)iO(n«mi scored nl I pro^ocots for ttiuso four vnrlabtes, as wott 
as poputurs, nvoriicjc* response tong ttr and repo 1 1 linns. Ucscriptivo sta- 
tistics, internal const s Icncy ro I I abl 1 1 i los, and inlorcorroInMons of the 
variables an* lepurled, as well os concurrent validities against a solf- 
iL'purt (|uc)ii1 innnni ro .itid ronipari soni; of '.'.ex and lonch Muj- I ovol subsamplos. 




FILMED FROM BEST AVAILABLE COPY 



AUTOMATED SENTENCE COMPLETION SCORING 

Dona Id J . Ve I dman 
The University of Texas at Austin 



Personality assessment techni ques vary considerably in terms of 
the degree' of structure provided to the respondent, Ousstionnai res re*- 
quire only choices among supplied alternatives, while story-telling tasks 
may provide no structured stimuli at all. The sentence completion tech- 
nique lies somewhere between these two extremes, and is a popular tech- 
nique for persona I i ty assessment. 

Interpretation of verbal responses to sentence completion items 
is usually a matter of c I i ni ca I intui t i on; the extreme variety of possible 
responses makes development of objective scoring procedures very difficult. 
To facilitare the construction of a computer-based scoring system for sen- 
tence completion responses Veldman, Menaker, and Peck ( 1969) devi sed a form 
with instructions to use no more than one word to complete each stem. A 
great deal of experimentation with various types of stems ap'd response- 
reduction techniques led to the current system, which is presently in use 
at The University of Texas as part of a personal assessment program for a I I 
students in the undergraduate teacher education program. 

Development of the System 

A total of 1718 protocols ware gathered using a 62-item form 
during a full year in the College of Education. All responses were trans-- 
ferred to punch cards. A ten-character response limit permitted data from 
one respondent to be punched in nine cards. A computer routine was inen 
used to compile for each stem a list of all different responses and their 
frequencies. These lists varied in length from 33 to 538 responses. 

The author then examined each list to identify five types of re- 
sponses. Popu I a rs were defined as words used by more than ten percent of 
the respondents. Evasive responses included blanks, proper names, stern 
word repetitions and other cryptic ansv/ers. Host i I e responses v/ere pri- 
mari ly instances of derogation of other people. Anxiety indicators included 
both direct and projected expressions of fear and tension. Depress i on in- 
dicators included direct and projected self-derogation and pessimism. 

The E, H, A, and D response words were converted to root forms 
(confused, confusing, confusion = confus) and punched on cards to assemble 
a scoring "dictionary." No response word was coded for more than one cate- 
gory on one stem, although the same word might be coded differently on dif- 
ferent stems. 

A scoring program was then written and applied to all of the 
original 1718 protocols. In addition to the four "clinical" scores, the 
program computed the average length in characters of the subjects' 62 
responses, and also counted the number of repetitions of response words 
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within the protocol. An eighth total negative affect score was comp"ted 
as the sum of host! I ity, anxiety, and depression scores. 

Statistical Properties of the Scores 

Central tendency and var i ab i I ity i nd ices and alpha coefficients 
of internal consistency were computed for all eight variables. 

Average Response Length (ARL). Msan = 6.60, sigma = .51 , alpha = . 

Repetitions (REP) . Mean = 1.0, sigma = 4.2, alpha = .62 . 

Popu lars (POP) . Mean = 19.0, sigma =4.7, alpha = .59. 

Evasion (EVA). Median = 1.5, alpha = .70. 

Host! I i ty (nos ) . Med Ian = I . 5, a I pha = . 49 . 

Anxiety (ANX). Median =1.5, alpha = .33. 

Depression (PEP) . Median = 1.5, alpha = .50. 

Total Negative Affect (TNA). Mean = 6.3, s|gma = 3.8, alpha = .66. 

The evasion, host i I ity, anxiety, and depression score distribu- 
tions were quite simi lar. Roughly 2555 of the respondents gave zero, one, 
two, and more than two of each. 

Intercorrelations of the scores are shown in Table I. Short re- 
eponses tend to be repeated and popular. Populars tend to be inversely re- 
lated to evasion, hostility, and depression. 

Concurrent Validity 

Another instrument in the personal assessment battery completed 
by these students was the 56-item Ad jecti ve Se I f-Descr i pt i on (Veldman and 
Parker, 1970), which yields seven trait measures. Correl at ions betv/een 
these and the sentence completion variables are shown in Table 2. 

Response length and repetitions had no strong corre I at:is. Popu- 
lars were associated with warmth, I ack of abrasi veness, efficiency, and 
practicality. Evasion had no strong correlates. Hostility v/as related to 
abrasiveness, lack of warmth, and anxiety. Anxiety corre I ated with its 
counterpart. Depression v/as related to abrasiveness, inefficiency, and 
anxiety. 



The fact that these relationships were only moderate on the whole 
can be interpreted as evidence that the sentence completion method is tap- 
ping rather different sources of variance than the highly structured ques- 
tionnaire. Such lack of redundancy is a desirable feature for use in a 
mu I ti-i nstrument battery. 

Comparison of Sexes and Teaching Levels 

The total group of 1718 students contained 341 males and 1377 fe- 
males. Among the females were 457 elementary and 920 secondary majors. In 
Table 3 are shown the results of analyses of variance comparing these groups 

Among the female students, the elementary majors use more popular 
responses and show less evasion, hostility, and depression. Among the 
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secondary majors, males give shorter responses and more rspstitions, use 
■fewer populars, and more evasives, indicate greater hostility and less 
anxiety than do the females. 

Applications of the System 

A major advantage of the one-word sentence completion technique 
is that the same protocols may serve multiple purposes in a large-scale 
assessment program. The computer-generated scores can be automatically 
scanned to identify students who reveal c| ear evidence of need for per- 
sona I counseling. When such cases are identified by such a screening 
system, or when students voluntarily seek counsel i ng services, the original 
protocols are also available for clinical interpretation along with other 
assessment data derived from more and from less structured stimulus in- 
struments. 

/ 

To aid clinical use of the instrument, a computer program has 
been developed which pri nts a one-page summary cif -the results of the 
scoring system, including verbatim reproduction of E, H, A, and D responses 
embedded in the sentences in which they were given. 
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Table I. Intercorrelations of the Sentence Completion Variables 



Scale 


ARL 


REP 


POP 


EVA 


HOS 


AMX 


DEP 


TNA 


ARL 


— 


-46 


-27 


-08 


-01 


06 


-08 


-03 


REP 


-46 


— 


36 


-06 


-16 


-10 


-06 


-16 


POP 


-27 


36 


— 


-25 


-30 


-08 


-27 


-33 


EVA 


-08 


-06 


-25 


— 


-02 


-10 


-04 


-08 


HOS 


-01 


-16 


-30 


-02 


— 


13 


32 


73 


ANX 


06 


-10 


-08 


-10 


13 


— 


20 


57 


DEP 


-08 


-06 


-27 


-04 


32 


20 


— 


76 


TNA 


-03 


-16 


-33 


-08 


73 


57 


76 


— 



O 

ERIC 



#■ 
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Table 2. Correlations of Sentence Completion with ASD Variables 



ASD Variables 


ARL 


REP 


POP 


EVA 


HOS 


ANX 


DEP 


TNA 


Social Warmth 


-02 


04 


18 


-07 


-21 


-01 


-13 


-18 


Social Abrasiveness 


-03 


-07 


-20 


08 


23 


06 


25 


27 


Ego Organization 


03 


06 


15 


-06 


-18 


-07 


-24 


-24 


1 ntroversion/Extravers i on 


-07 


03 


-05 


-01 


01 


12 


17 


14 


Neurotic Anxiety 


00 


-03 


-09 


-03 


20 


25 


30 


36 


Idea 1 i sm 


1 1 


-09 


-17 


10 


09 


-05 


05 


05 


Social Attractiveness 


08 


-01 


07 


-08 


-02 


-09 


-15 


-15 



Table 3. Mean Differences Betv/een Sexes and Teaching Levels 



OWSC 

Variable 


FE 

Mean 


/ 

P 

level 


FS 

Mean 


p 

1 eve 1 


MS 

Mean 


Average Response Length 


6.64 


ns 


6.62 


.0006 


6.50 


Repetitions 


9.60 


ns 


9.87 


.0004 


10.87 


Populars 


20. I I 


.005 


19.35 


<.0001 


16.71 


Evasion 


1.61 


.002 


2.03 


<.0001 


2.87 


Host i 1 i ty 


1.83 


.002 


2.17 


.0002 


2.69 


Anxiety 


2.04 


ns 


1 .96 


< .000 1 


1.37 


Depression 


2.04 


.09 


2.23 


ns 


2.40 


Total Negative Affect 


5.91 


.03 


6.37 


ns 


6.47 


N 


457 


- 


920 




341 



